Search for: All records

Self-supervised learning(SSL) is essential to obtain foundation models in NLP and CV domains via effectively leveraging knowledge in large-scale unlabeled data. The reason for its success is that a suitable SSL design can help the model to follow the neural scaling law, i.e., the performance consistently improves with increasing model and dataset sizes. However, it remains a mystery whether existing SSL in the graph domain can follow the scaling behavior toward building Graph Foundation Models~(GFMs) with large-scale pre-training. In this study, we examine whether existing graph SSL techniques can follow the neural scaling behavior with the potential to serve as the essential component for GFMs. Our benchmark includes comprehensive SSL technique implementations with analysis conducted on both the conventional SSL setting and many new settings adopted in other domains. Surprisingly, despite the SSL loss continuously decreasing, no existing graph SSL techniques follow the neural scaling behavior on the downstream performance. The model performance only merely fluctuates on different data scales and model scales. Instead of the scales, the key factors influencing the performance are the choices of model architecture and pretext task design. This paper examines existing SSL techniques for the feasibility of Graph SSL techniques in developing GFMs and opens a new direction for graph SSL design with the new evaluation prototype. Our code implementation is available online to ease reproducibility https://github.com/HaitaoMao/GraphSSLScaling. 

An advantage of Large Language Models (LLMs) is their contextualization capability – providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard feedback. We present a design and evaluation of a proof-of-concept LLM application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT, which offers students contextualized reflection triggers during a collaborative query optimization task in database design. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context. We discuss in depth the exploration of the design space of the triggers and their correspondence with the learning objectives as well as the impact on student learning in a pilot study with 34 students. 

Abstract While whistler‐mode waves are generated by injected anisotropic electrons on the nightside, the observed day‐night asymmetry of wave distributions raises an intriguing question about their generation on the dayside. In this study, we evaluate the distributions of whistler‐mode wave amplitudes and electrons as a function of distance from the magnetopause (MP) on the dayside from 6 to 18 hr in magnetic local time (MLT) within ±18° of magnetic latitude using the Time History of Events and Macroscale Interaction During Substorms measurements from June 2010 to August 2018. Specifically, under different levels of solar wind dynamic pressure and geomagnetic index, we conduct a statistical analysis to examine whistler‐mode wave amplitude, as well as anisotropy and phase space density (PSD) of source electrons across 1–20 keV energies, which potentially provide a source of free energy for wave generation. In coordinates relative to the MP, we find that lower‐band (0.05–0.5f_ce) waves occur much closer to the MP than upper‐band (0.5–0.8f_ce) waves, wheref_ceis electron cyclotron frequency. Our statistical results reveal that strong waves are associated with high anisotropy and high PSD of source electrons near the equator, indicating a preferred region for local wave generation on the dayside. Over 10–14 hr in MLT, as latitude increases, electron anisotropy decreases, while whistler‐mode wave amplitudes increase, suggesting that wave propagation from the equator to higher latitudes, along with amplification along the propagation path, is necessary to explain the observed waves on the dayside. 

The redshifted 21 cm signal from the Epoch of Reionization (EoR) directly probes the ionization and thermal states of the intergalactic medium during that period. In particular, the distribution of the ionized regions around the radiating sources during EoR introduces scale-dependent features in the spherically averaged EoR 21 cm signal power spectrum. Aims. The goal is to study these scale-dependent features at different stages of reionization using numerical simulations and to build a source model-independent framework to probe the properties of the intergalactic medium using EoR 21 cm signal power spectrum measurements. Methods. Under the assumption of high spin temperature, we modeled the redshift evolution of the ratio of the EoR 21 cm brightness temperature power spectrum to the corresponding density power spectrum using an ansatz consisting of a set of redshift and scale-independent parameters. This set of eight parameters probes the redshift evolution of the average ionization fraction and the quantities related to the morphology of the ionized regions. Results. We tested this ansatz on different reionization scenarios generated using different simulation algorithms and found that it is able to recover the redshift evolution of the average neutral fraction within an absolute deviation ≲0.1. Conclusions. Our framework allows us to interpret 21 cm signal power spectra in terms of parameters related to the state of the IGM. This source model-independent framework is able to efficiently constrain reionization scenarios using multi-redshift power spectrum measurements with ongoing and future radio telescopes such as LOFAR, MWA, HERA, and SKA. This will add independent information regarding the EoR IGM properties. 

Interchange instability is known to drive fast radial transport of particles in Jupiter's inner magnetosphere. Magnetic flux tubes associated with the interchange instability often coincide with changes in particle distributions and plasma waves, but further investigations are required to understand their detailed characteristics. We analyze representative interchange events observed by Juno, which exhibit intriguing features of particle distributions and plasma waves, including Z‐mode and whistler‐mode waves. These events occurred at an equatorial radial distance of ∼9 Jovian radii on the nightside, with Z‐mode waves observed at mid‐latitude and whistler‐mode waves near the equator. We calculate the linear growth rate of whistler‐mode and Z‐mode waves based on the observed plasma parameters and electron distributions and find that both waves can be locally generated within the interchanged flux tube. Our findings are important for understanding particle transport and generation of plasma waves in the magnetospheres of Jupiter and other planetary systems. 

Abstract Element isotopes are characterized by distinct atomic masses and nuclear spins, which can significantly influence material properties. Notably, however, isotopes in natural materials are homogenously distributed in space. Here, we propose a method to configure material properties by repositioning isotopes in engineered van der Waals (vdW) isotopic heterostructures. We showcase the properties of hexagonal boron nitride (hBN) isotopic heterostructures in engineering confined photon-lattice waves—hyperbolic phonon polaritons. By varying the composition, stacking order, and thicknesses of h¹⁰BN and h¹¹BN building blocks, hyperbolic phonon polaritons can be engineered into a variety of energy-momentum dispersions. These confined and tailored polaritons are promising for various nanophotonic and thermal functionalities. Due to the universality and importance of isotopes, our vdW isotope heterostructuring method can be applied to engineer the properties of a broad range of materials. 

Abstract We present multi‐platform observations of plasma cloak, O+ outflows, kinetic Alfven waves (KAWs), and auroral oval for the geomagnetic storm on 17 March 2015. During the storm's main phase, we observed a generally symmetric equatorward motion of the auroral oval in both hemispheres, corresponding to the plasmasphere erosion and inward motion of the plasma sheet. Consequently, Van Allen Probes became immersed within the plasma sheet for extended hours and repeatedly observed correlated KAWs and O+ outflows. The KAWs contain adequate energy flux toward the ionosphere to energize the observed outflow ions. Adiabatic particle tracing suggests that the O+ outflows are directly from the nightside auroral oval and that the energization is through a quasi‐static potential drop. The O+ outflows from the nightside auroral oval were adequate (‐ #/‐s) and prompt (several minutes) to explain the newly formed plasma cloak, suggesting that they were a dominant initial source of plasma cloak during this storm. 

Abstract We present statistical distributions of whistler‐mode chorus and hiss waves at frequencies ranging from the local proton gyrofrequency to the equatorial electron gyrofrequency (f_ce,eq) in Jupiter's magnetosphere based on Juno measurements. The chorus wave power spectral densities usually follow thef_ce,eqvariation with major wave power concentrated in the 0.05f_ce,eq–f_ce,eqfrequency range. The hiss wave frequencies are less dependent onf_ce,eqvariation than chorus with major power concentrated below 0.05f_ce,eq, showing a separation from chorus atM < 10. Our survey indicates that chorus waves are mainly observed at 5.5 < M < 13 from the magnetic equator to 20° latitude, consistent with local wave generation near the equator and damping effects. The hiss wave powers extend to 50° latitude, suggesting longer wave propagation paths without attenuation. Our survey also includes the whistler‐mode waves at high latitudes which may originate from the Io footprint, auroral hiss, or propagating hiss waves reflected to highMshells.